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ABSTRACT 

Information to promote assessment of organizational 
effectiveness in colleges and universities is presented, along with 
an exercise to rank the effectiveness of 10 institutions. The 
exercise uses three types of criteria to indicate effectiveness: 
subjective ratings, data about studen%.s and activities, and 
institutional capacity fTid financial health. In ranking the colleges, 
the respondent is to generate three rank-order lists basesl on the 
perspectives of three different individuals: a high school senior who 
is choosing a college, a highly qualified Ph.D. who is selecting a 
college as an employer, and an official of a foundation who is 
looking for a college to fund. Information is provided on: questions 
to ask and ways to measure organizational effectiveness in higher 
education; factors affecting job attitudes; advantages of focusing on 
faults instead of on indicators of institutional effectiveness; a 
procedure for assessing ineffectiveness; fault tree analysis; the 
nominal group technique; computing a strategic path; nine dimensions 
of organizational effectiveness; a comparison of effectiveness for 
declining, stable, and growing schools; and a comparison of 
effectiveness of unionized and nonunionized institutions. (SW) 
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Analyzing Organizational Effectiveness In Ten Selected Institutions 
of Higher Education: A Case Study 

Kim Cameron 

Judging the effectiveness of colleges and universities Is 
difficult for a variety of reasons. Some have to cio with the nature of 
Institutions of higher education. Others are characteristic of all 
Judgments of organizational effectiveness. In this case, you are asked 
to make three Independent judgments of effectiveness. That Is, you are 
asked to rank order the effectiveness of ten Institutions Independently 
from three different perspectives. The data provided In this case 
relate to three types of criteria commonly used to Indicate 
effectiveness: (1) subjective ratings, (2) data about students and 
activities, and (3; Institutional capacity and financial nealth. These 
data are all available from public documents, so no violation of 
Institution confidentiality has occurred by presenting them here. 

Your task In analyzing this case Is to put yourself In the 
position of each of the Individuals Introduced below and to select. In 
rank Prder» the five most effective Institutions. BecausG There are 
three different Individuals, you will need to generate three different 
rank-ordered lists. These three lists may be exactly the same or they 
may be different. In addition to the Information presented In the 
case, you may use any other Information available to you In making your 
Judgment. But be prepared to Justify your selections. 

The three points of view you should adopt are as follows. 
1. John Jones Is a high school senior who wants to go to college. 
His objective Is to select the most effective Institution that 
he can find. He Is a National Merit Scholar and an 
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outstanding football player, so eligibility for admission Is 
no concern. He has limited his selection to the ten schools 
listed In the tables below. 

2. Jane Jones Is a new Ph.D. who wants to get a Job In the best 
Institution of higher education thcit she can find. She has an 
excellent track record coming out of her graduate program, and 
she is generally considered to be one of the best candidates 
on the market this year. She has narrowed her possibilities 
to the ten Institutions In the tables below, and her main 
objective is to select the one that Is most effective. 

3. Jack Jones is an official from the MacArthur Foundation who 
has a bundle of money to spend. The only constraint is that 
It must be spent on a project that produces a valuable return 
on the investment and that gives the Foundation some 
visibility. Jack has decided to provide a large amount of 
money to one of the ten schools listed in the tables below, 
but he wants t^^ select the most effective one to get the 
money. 

I. fialLOflfi 

There are a large number of "guides to colleges" published 
annually In order to help individuals make choices about institutions 
of higher education. While the espoused purpose of these guides Is not 
to assess organizational effectiveness. In practicality, they are 
frequently used as a basis for doing Just that. Some of the guides 
even encourage readers to make such Judgments (e.g., Barron's, "The 
Best, Most Popular, and Most Exciting Colleges," or McCllntock's "100 



Top Col leges: How to Choose and Get In"). One of the best known 
guides was published recently by the Now York Times in which "academic 
quality," "social life," and "quality of life," was rated at 250 
Institutions ir America. The ratings for the ten Institutions on those 
three dimensions are reported In Table 1. The ratings range from 5 
(top) to 1 (low). 



Table 1 - New York Times Ratings (SOURCE: Edward B. FIske, 

Selective Guide to Hnl Iflgasr New York: Times Books, 1982) 



School 


Academics 


Social 


Oualltv of life 


Average 


Brigham Young University 


3 


3 


4 


3.33 


University of Gal Ifornia 








Berkeley 


5 


3 


3 


3.67 


Carnegie-Mel Ion 








Un 1 vers 1 ty 


4 


3 


3 


3.33 


University of (^lorado 








8ou 1 der 


3 


5 


5 


4.67 


Duke University 


4 


4 


4 


4.00 


Florida State University 


3 


3 


3 


3.00 


Penn State University 


3 


5 


3 


3.67 


University of Texas 










Austin 


5 


4 


4 


4.33 


University of Wisconsin 










Mad 1 son 


5 


5 


3 


4.33 


Yale University 


5 


3 


4 


4.00 



The highest overall rating Is given to the University of 
Colorado - Boulder fol lowed by the University of Texas and the 
University of Wisconsin. Florida State Is rated lowest, with Brigham 
Young and Carnegie-Mellon next lowest. 



Another type of reputatlonal rating can be produced by asking 
faculty members to rate the effectiveness (or quality, reputation, 
excellence, and so on) of various disciplines or departments at 
Institutions of higher education. This essentially produces a set of 
peer evaluations of Institutions and their programs. One such survey 



was recently conducted by the Conference Board of Associated Research 
Ck)unclls, and It focused on various fields of study In graduate 
education. Table 2 reports 13 selected fields of study In the social, 
biological, and physical sclenes, and In humanities t^nd engineering. 
The ratings resulted from the perceptions of over 500 faculty members 
In each of the different areas. A score of 50 Indicates the mean, and 
the standard deviation Is 10. (See Taule 2.) 



TABLE 2 ABOUT HERE 



Two different ratings are reported In the table. The first Is a 
rating of "the scholarly competence and achievements of faculty 
members." The second Is a rating of "the effectiveness of those 
departments In educating research scholars." Whereas wide variation 
exists In different fields of study within Institutions, an average of 
the ratings of these selected fields of study may give some Indication 
of overall Institutional effectiveness. Considering only the overall 
average, the University of California Is rated most highly followed by 
Wisconsin and Yale. The lowest rated school Is Brigham Young followed 
by Florida State. (It should be noted that "how familiar CratersU were 
with each program being rated" was highly correlated with the ratings 
received. That Is, programs that were more familiar to raters received 
higher ratings.) 

II. Students and Activities 

One might assume that a college or university Is effective If It 
can attract the very best students to attend. It seems reasonable that 
the Dest (smartest) students attend Institutions that they Judge to be 
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Table 2 - Ratings of Selected Fields of Study in Graduate tducation (SOURCE: 
Chronicle of Higher Education , 9/29/82, 11/10/82, r/1/82, 1/12/83, 
1/19/83). 



CONFERENCE BOARD OF ASSOCIATE RESEARCH COUNCILS RATINGS 
( Faculty Ratings MEAN =50 SD = 10) 
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43 47 


40 * 


43 47 


40 36 


47 46 






Ik Ik 




45 45 




* * 


44 


65 65 


69 65 


69 65 


65 65 


55 56 


71 70 


75 74 


71 70 


69 65 


67 68 


74 72 


72 71 


72 70 


68 


57 62 




65 65 






60 61 


57 56 








54 53 


53 57 


59 59 


58 


44 46 


44 46 


64 63 


42 46 




53 53 


53 54 


50 52 


44 43 


39 39 


58 57 


52 54 


54 55 


50 


56 58 


56 59 


61 60 


62 65 


67 67 




50 ^9 


57 57 


46 43 


56 56 


54 55 


52 49 


53 54 


56 


43 45 


48 49 


53 53 










39 38 


46 44 


37 37 


57 57 


47 49 


53 52 


47 


47 47 


47 51 


61 61 


42 41 


43 43 


53 53 


46 50 


53 55 


47 48 


51 53 


60 60 


53 55 


48 52 


51 


49 48 


60 60 


63 61 


68 67 


56 57 


61 60 


37 36 


59 60 


55 56 


69 68 


63 61 


40 39 


62 55 


57 


65 66 


70 73 


64 63 


60 60 


62 66 


72 72 


59 59 


60 61 


57 56 


63 65 


69 67 


65 66 


61 60 


64 


71 68 


62 58 


70 69 


63 61 


63 61 


50 50 




73 71 


57 55 


68 65 


64 64 


69 67 


65 65 


64 



I"***"© tings not reported in the source. 
F 
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lEgJC'culty Quality = the perceived quality of the faculty In scholarly activity 
''^fl feet f veness ■ the perceived effectiveness In educating students to be scientists & scholars 



most effective In providing them with what they want. Furthermore, 
high quality students are expected to keep the academic effectiveness 
of the institution high Just by their presence. Therefore, knowing 
where the best students go should help Identify the best schools. 

Table 3 reports the number of National Merit Scholars attending 
each of the 10 selected schools, as well as the national rank of those 
schools (I.e., their rank relative to all schools In the country) and 
their rank relatively to the other nine schools In the case. Note that 
Yale Is ranked highest, followed by Texas and Duke. Wisconsin Is 
ranked lowest followed by Carnegie-Mellon and Colorado. 



Table 3 - Institutional Attendance of National Merit Scholars (1982* 
(SOURCE: Chrcnlcle of Higher Educwt'nn, 2/2/83) 







National Rank 


Case Rank 


Brlgham Young University 


27 


48 


7 


University of California 


42 


31 


5 


Carnegie-Mellon University 


21 


58 


9 


University of Colorado 


22 


54 


8 


Duke University 


64 


17 


3 


Florida State University 


46 


27 


4 


Penn State Unlversl+y 


29 


45 


6 


University of Texas 


130 


8 


2 


University of Wisconsin 


20 


60 


10 


Yale University 


171 


5 


1 



Another potential Indicator of Institutional effectiveness Is the 
extent to which students have access to faculty members at the 
Institution, When classes are large, or they are taught by graduate 
students rather than by professors, the educational progress of 
students Is generally assumed to suffer when compared to Institutions 
where class size Is small, and where students have a chance to Interact 
with the faculty. One rather crude measure of student-faculty 
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Interaction Is the ra-'-lo of students per faculty member. Whereas there 
my be high variety In the degree to which faculty members are 
available to students In different Institutions, and In the teaching 
load of faculty members which brings them Into contact with students, 
student-faculty ratios have nevertheless been used as an Indicator of 
effectiveness In published documents. Table 4 reports these ratios for 
the 10 schools. Note that Yale has the most favorable student-faculty 
ratio, followed by Duke and Carnegie-Mellon. The University of Texas 
has the least favorable student-faculty ratio, followed by Penn State 
and Brigham Young. 



Table 4 - Student-Faculty Ratios - 1980 (SOURCE: Col lege Facts 
Chart > IQao-ai, National Beta Club) 



iCJlfi&L Student-Faciiltv Ratio 

Brigham Young University 19:1 

University of California 14:1 

Carnegie-Mellon University 13:1 

University of Colorado 16:1 

Duke University 9:1 

FlorldG State University 15:1 

Penn State University 21:1 

University of Texas 23:1 

University of Wisconsin 18:1 

Yale University 6:1 



Whereas some criteria for Judging effectiveness are seldom 
acknowledged In the published literature, they nevertheless are held as 
Important Indicators for some Individuals. One example Is the success 
schools pursue In Intercollegiate athletics. That Is, major resources 
and energy are directed toward producing winning teams and gaining 
national exposure. One president of a perennial football power In the 
Midwest recently commented, for example, "Our goal Is to have a 
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university our football team can be proud of." Winning football and 
basketball teams produce not only regional and national exposure for 
the Institution, but they also may contribute to the InstI tutlon'^s 
ability to acquire resources for other programs or activities as wel L 
Table 5 reports the 1982 season football records, the number of 
televised football games In which the Institution has been Involved, 
and the number of professional football players representing each of 
the ten Institutions. 



T«»ble 5 - Visibility and Success of Football Program (SOURCES: 
Chronicle of Higher Education, 5/4/81, 9/22/82; NCAA) 



Number of 
Number of Pro Footbal I 
School Season Record-1982 Times on TV Players-1980 

Brigham Young University 
University of California 
Carnegie-Mel Ion 

University 
University of Colorado 
Duke University 
Florida Slate University 
Penn State University 
University of Texas 
University of Wisconsin 
Yale University 

a lost Hoi I day Bowl 

b did not participate In a post-season bowl 
c won Gator Bowl 
d won Sugar Bowl 
e lost Sun Bowl 
f won Independence Bowl 



8-3 a 


20 


5 


7-4b 


28 


16 


6-3b 


0 


0 


2-9-1 b 


20 


24 


6-5b 


19 


5 


8-3c 


18 


5 


10-1d 


42 


29 


9-2e 


57 


17 


6-5f 


24 


8 


4-6b 


20 


1 



By these three measures of effectiveness, Penn State and Texas 
appear to have the most success and potentially the most visibility for 
their Institutions as a result of their football programs. Yale and 
Carnegie-Mellon appear to be the least successful on these criteria. 
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III. Capaelty wnd Flnnnreg 

Among the criteria of Institutional effectiveness that appear 
frequently In published assessments are Indicators of Institutional 
capacity and financial health. For example, access to scholarly 
material Is often equated with size and currency of library holdings. 
Table 6 reports the size of the libraries of the ten schools along with 
a national ranking given them by the Association of Research Libraries 
based on expenditures, currency, holdings, etc. On the basis of this 
criterion of Institutional capacity, California and Yale are clearly at 
the top while Carnegie-Mellon and Florida State are at the bottom of 
these ten schools. This criterion may Indicate the ef* ctlveness of an 
Institution In providing scholarly support for Its students and 
faculty. 



Table 6 - Rankings of University Libraries (SOURCE: Chronicle 
of Higher Friuratlnn. 1/27/82) 



SShSQL Number Pf YplumeS National Ranking 

Br I gham Young University 1,574,000 58 

University of Cal Ifornla 6,117,000 2 

Carnegie-Mel Ion University « « 

University of Colorado 1,928,000 68 

Duke University 3,084,000 30 

Florida State University 1,414,000 7i 

Penn State University 2,273,000 21 

University of Texas 4,847,000 7 

University of Wisconsin 4,184,000 12 

Yale University 7,725,000 4 



* not In top 100 libraries 

Indicators of Institutional financial health aiso are used 
frequently In assessments of Institutional effectiveness or well-being. 
In fact, quite a large literature has emerged on that topic over the 
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last several years. Mhereas there has yet to be produced a set of 
agreed upon indicators of financial health, there are some Indicators 
that most people accept as reasonable cr Iter I a of financial 
effectiveness In colleges and universities. Table 7 contains e listing 
of five such Indicators which are defined as follows: 



Financial Independence - tha proportion of revenues received 

from six different sources 

Financial Flexibility - the proportion of unrestricted revenues 

Financial Cushion - the proportion of current revenues left 

unspent 

Revenue Drawing Power - the ability of the Institution to 

attract revenues 

Endowment Yle!c' - the amount of endowment Income relative to 
other similar schools 



These Indicators relate, austenslbly, to the ability of the 
Institution to survive over time and to garner enough financial 
resources to meet Its needs. The ability to use resources In areas 
where they are most needed Is also Included In these criteria. 

TABLE 7 ABOUT HERE 



in terms of f InLnclal health, Yale University appears to be the 
most effective ins-^itution (although It Is relatively weak In financial 
Independence) followed by Texas (which Is relatively weak In revenue 
drawing power) and Carnegie-Mel Ion (which Is also relatively weak in 
financial Inder ^ndence). The least healthy or least effective 
Institutions on these critwria are Florida State University followed by 
erirhsri: Young and Colorado. 
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able 7 - Selected Measures of Financial Health (^OURCE: HEGIS file at NCHEMS, 1980-81) 



Fi nancia I 



chool 



F inancia I 



Financia I 



Endowment Combined 



Brigham Young 
|||)al ifornia 

Carnegie Ae\ Ion 
Bolorado 
T)uke 

rflorida State 
Wenn State 
Jexas 
scons in 
Yale 



t 
I 
I 
I 
I 
I 
I 



1 ndependence 


F lexibi 1 ity 


Cush ion 


Power 


Yield 


Rank 




Rank 


I 


Rank 




Rank 


I 


Rank 


I 


Rank 




.75 


(10) 


.25 


(1 ) 


-.20 


(10) 


465 


(9) 


-.73 


(8) 


9 


1 .32 


(5) 


.04 


(7) 


.24 


(5) 


585 


(4) 


-.16 


(4) 


4 


1.17 


(8) 


.13 


(3) 


.44 


(3) 


614 


(3) 


-.04 


(3) 


3 


1 .50 


(2) 


.04 


(7) 


.11 


(8) 


459 


(10) 


-.81 


(9) 


8 


.96 


(9) 


.06 


(5) 


.31 


(4) 


663 


(2) 


-.24 


(6) 


5 


1 .20 


(6) 


.01 


( 10) 


.10 


(9) 


495 


(6) 


-.83 


(10) 


10 


1.53 


(1) 


.04 


(7) 


.12 


(7) 


486 


(8) 


-.18 


(5) 


6 


1 .49 


(3) 


.10 


(4) 


1 .54 


(1 ) 


492 


(7) 


1 .53 


(2) 


2 


1 .47 


(4) 


.05 


(6) 


.17 


(6) 


520 


(5) 


-.61 


(7) 


6 


1.18 


(7) 


.14 


(2) 


.87 


(2) 


675 


(1) 


2.07 


( 1 ) 


1 



Except for 1he ranks , the higher the number the better. 



FerIc 



14 



BEST COPY AVAILABLE 



A final criterion of Institutional effectiveness Included In this 
case relates to the ability of the Institutions to acquire research 
revenues. Since each of these ten schools claim as part of their 
domain the generation of new knowledge through research and 
scholarship, the presence of research grants provides ot least one 
measure of success In this endeavor. Table 8 reports the anount of 
federal, state, and local research grants obtained for each of the 
Institutions during 1980-81 • 



Table 8 - Research Grants (SOURCE: HEGIS file at NCHEMS, 1980-81) 



Using this criterion of effectiveness, the University of Wisconsin 
rates highest followed by Yale and California. Brigham Young, which 
accepts no federal, state, or local funds. Is last followed by Florida 
State and Carnegie-Mellon. 

Conclusion 

The criteria of Institutional effectiveness Included In this case 
are Just a sampling of the many possible Indicators that could be used. 
In making your Judgments about the most effective Institutions from rhe 
three perspectives, you may want to consider other criteria In addition 



School 



Research Grant 
Total (In millions) 



Brigham Young University 
University of California 
Carnegie-Mellon University 
University of Colorado 
Duke University 
Florida State University 
Penn State University 
University of Texas 
University of Wisconsin 
Yale University 



0.0 
90.1 
26,7 
31.5 
46.3 
21.2 
39.1 
67.4 
115.3 
96.1 
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to those listed here. Just be sure you can give a rationale for ycur 
selections. 

In thinking about relative effectiveness, you may also want to 
consider questions such as these. Which Institutions are likely to 
survive the 1980s in the best shape? Which Institutions are most 
likely to do the most flfifld (In addition to doing ifiJI)? Which 
Institutions fuiflM a unique need In American higher education? 
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TABLE 9 A Summary of Rankings on the Eight Criteria of Effectiveness 
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Brigham Young University 


8 


10 


7 


8 


4 


7 


9 


10 


University of California-Berkeley 


6 


1 


5 


4 


3 


1 


4 


3 


Carnegie-Mellon University 


8 


4 


9 


3 


10 


10 


3 


8 


University of Colorado-Boulder 


1 


8 


8 


7 


6 


8 


8 


7 


Duke University 


4 


6 


3 


2 


8 


6 


5 


5 


Florida State University 


10 


9 


d 


5 


7 


9 


10 


9 


Penn State University 


6 


7 


6 


9 


1 


5 


6 


6 


University of Texas-Austin 


2 


5 


2 


10 


2 


3 


2 


4 


University of Wisconsin-Madison 


2 


2 


10 


6 


5 


4 


6 


1 


Yale University 


4 


2 


1 


1 


9 


2 


1 


2 
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SEMINAR OBJECTIVES 



1, Help participants become aware of the 
problems involved In assessing organizational 
effectiveness in colleges and universities. 

2, Help participants understand alternative 
approaches to assessing and improving 
organizational effectiveness. 

3, Help participants ellnilnate organizational 
faults and weaknesses that inhibit the 
effectiveness of their institutions. 

1. Help participants identify strategies 
that will enhance the effectiveness of 
their institutions. 

5, Great an action plan for Instituting 
changes . 
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Unquestionably^ universities are among the worst 
managed institutions In the country. Hospitals and 
soipe state and city administrations may be as bad; 
but no business or industry except Penn Central[whlch 
subsequently went bankrupt] could possibly be. One 
reason^ Incredibly enough, is that universities— which 
have studied everything from government to Persian 
mlmrs and the number seven— hove never deeply studied 
their own administration. 



Warren Bennls. 1973 
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This evaluation will be a waste of time, for 
either It will demonstrate that the program 
Is excellent or that It Is defective In some 
sense. In the first case It Is a waste of 
time because we already know that It's a good 
program, and In the second, it's a waste of 
time because we would not believe any 
evidence of weakness. 



from a study conducted by 
Paul Dressel. 1971. 



OBJECTIVES OF WORCESTER STATE 



"Worcester State's objectives ore to graduate students at 
the undergraduate and graduate level, who ore responsible 
members of modern society; knowledgeable of our western 
heritage and appreciative of other cultures; conversant 
with science, concerned with social problems, and respect- 
ful of human values; skillful In the process of analysis, 
able to Judge between competing claims and creative In 
their thinking; alert and fluent In defense of fundamental 
rights and courageous in their beliefs." 

SOURCE: WORCESTER STATE CATALOGUE 
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VHY ARE judgehents of 

0R6ARIZATI0RAL EFFECTIVERESS 
IR HIGHER EDUCAYIOR 

SO problehatic? 

1. Measurable criteria of effectiveness ore difficult 
to Identify In colleges end universities. 

2. Colleges end universities frequently consider 
themselves to be unique and Incoeiparable to 
other Institutions. 

3. Models of organizational effectiveness thit were 
developed In other types of organizations may have 
limited applicability to higher education. 

Most investigations of organizational performance 
rely on oversimplified proxy measures of effectiveness 
that apply to a limited number of schools. 
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The only way you can criticize a university^ 
the only way you can appraise It^ the only way 
you can determine whether it's good or bad or 
medium or Indifferent^ Is to know what It's 
about, what it's supposed to be, what it's 
supposed to be doing. If you don't know these 
things, you haven't any standards of criticism 
. . . (Universities) haven't any very clear 
Ideas of what they're doing or why. They don't 
even know what they are. 

Robert Maynard Hutchlns, 19"5. 



Some people have tried to compare our Institution with 
some elite schools, calling us "the Harvard of the West." 
We don't seek to be the Harvard of the West. Why we 
don't even seek to be the Yale of the West! 



Jeffrey Holland. 1982 
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MODEL 



DEFINITION 



WHEN USEFUL 



Goal Model 



System Resource 
Model 



Internal Process 
Model 



Strategic 

Constituencies 

Model 
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An Organization is 
effective to tlie 
extent that.... 



it accomplishes 
its stated goals. 



it acquires needed 
resources. 



it has an absence 
of internal strain, 
smooth internal 
functioning. 



Ail strategic 
constituencies are 
at least minimally 
satisfied. 
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Goals are clear, 

consensual, 

measurable 



Clear connection 
between inputs and 
outputs 



Clear connection 
between processes 
and primary task 



Constituencies have 
powerful influence; 
the organization 
reacts 



CONNONLY USED PROXY MEASURES 



— FOR ORGANIZATIONAL EFFECTIVENESS 
IN HIGHER EDUCATION — 



1. Reputatlonal ratings ("Rate the 5 schools that you 

think ore the best In this 
field.") 



2. Faculty honors and Publication counts (Guggenheim 

fellowships^ federal 
government appointments/ 
etc.) 



3. citation counts (Relying mainly on citation Indexes) 



'I. Starting salaries of graduates 



5. Entrance exam scores of beginning students (SAT^ 

ACT/ etc.) 



6. size of the library and the physical plant (The 

number of books per students 
the amount of scientific 
laboratory equipments etc.) 
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CRITICAL GUIDELINES 'N ASSESSING 
ORGANIZATIONAL EFFECTIVENESS 



QUESTION 

1. What is the purpose of the 
ossessment? 



2. What domain of qrtlvltv is 
being consiaered? 



3. Which constituency's 
fifilSBfeCllie Is being 
consiaered? 



What level of onnlvs|«^ is 
be 1 ng useay 

5. What time frame Is being 
employed? 

6. What type of data are to 
be gaine rea? 



7. What referent is used to 
make judgements? 



A Purpose of Identifying 
organization strengths may 
produce different data than 
0 Purpose of finding places 
to cut the budget. 

Criteria differ when internal 
activities are assessed versus 
external activities. 

Major funders may value different 
criteria than administrators. 



The effectiveness of the faculty 
is not the same as the effectiveness 
of the institution. 

Short-term versus long-term 
criteria may be contradictory. 

The perceptions of organization 
members may differ from certain 
factual or statistical Information. 

There are at least five referents 
against which to Judge effectiveness: 



comparative 
normative 
goal centered 



improvement 
traits 
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Organizational Efficiency 

1. Concerned witli internal organizational 
processes. 

2. Concerned witli reducing waste (or 
organizational "fat"). 

3. It means doing the same thing with fewer 
resources. 

4. It is generally relatively easily measurable, 
and It is Indicated by ratios such as cost 
per student, cost per In&tructional unit, 
cost per square foot of space, etc. 

5. It Is largely concerned with resource 
allocation as opposed to resource 
generation, with the use of resources 
rather than the acquisition of resources. 



r ^ 
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FACTORS AFFECTING JOB 71TTITUDES, AS 
REPORTED IN 12 INVESTIGATIONS 
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A fWpAJIilN BftoflffluA V INBWlDlRPHEfflfll aBPoRGaSzATIONAL^FECTIVENESS 



ORGANIZATIONAL LEVEL 



CONCERN OF 
MANAGERS 



Ineffectiveness 



Illness 



T 



CONCERN OF 
MEDICAL DOCTORS 



Effectiveness 



CONCERN OF 
RESFi\RCHERS 



High Effectiveness 




Excellent Health 



CONCERN OF PHYSICAL 
FITNESS SPECIALISTS 



INDIVIDUAL LEVEL 
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There Is no Invisible Hand to guarantee that choices 
mode without much regard to health and safety will 
magically avoid damaging health and safety^ especially 
when the harmful by-products of every Individual firm 
are mixed together... In unconsidered and unintentional 
and sometimes unknown and unpresedented Interoctlng 
combinations. It would not be surprising If^ in order 
to avoid harm^ enterprises needed to aim firmly at 
avoiding harm. 

Henry Shue^ 1981 
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SOME ADVANTAGES OF FOCUSING ON FAULTS 
INSTEAD OF ON INDICATORS OF 
INSTITUTIONAL EFFECTIVENESS 



1. It is easier to identify faults and weaknesses than 
strengths and positive characteristics. 

2. There Is more motivation to change with negative 
feedback. 

3. There Is more consensus possible regarding' faults 
than strengths. 

^. Identifying faults con Identify specific places where 
change can occur. 

5. Ineffectiveness Is more easily assessed than Is 
effectiveness. 
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THE DEFINITION OF ORGANIZATIONAL EFFECTIVENESS 
USING THIS APPROACH IS: 



•An organization has achieved basic effectiveness 
to the extent to which It Is free from characteristics 
of Ineffectiveness." 
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FAULT TREE ANALYSIS 



9 



^ ... was developed In the field of scfety engineering 
to evaluate the effectiveness of the Mlnuteman 
Missile System (l.e.^ faults had to be Identified 
and overcome In advance of happening) 

has not been applied to behavioral systems 

relies on deductive processes (l.e.> Identify 
faults that Inhibit effectiveness then determine 
their causes or manifestations) 
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suhhary of the procedure 
for assessing ineffectiveness 



A. Identify a group of experts who can validly assess 
the faults of the Institution. 

B. Have them determine the top fault by specifying 
the major (priority) indicator of Ineffectiveness 
In the organization. 

C. Have them Identify the primary faults or problems 
that contribute to the occurrence of that top fnult 
using consensus building methods. 

D. Continue the analysis on more specific levels of the 
tree until a level of specificity Is reached that 
Identifies a specific change strategy. 

E. Determine weights for the faults In the tree through 
the experts' subjective Judgments of Importance end 
frequency. 

F. Compute primary and secondary strategic paths through 
the logic gates. 

6. Identify prioritized change and redesign strategies 
for improving organizational effectiveness based on 
the strategic paths. 
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NOMINAL GROUP TECHNIQUE 



1. A specific question Is Identified. 

2. Each group member Independently writes down all the 
alternatives they can think of. 

3. Each group member shares me alternative at a tlme^ 

In turn^ until all Ideas nave been shared and recorded. 

'it No evaluation of alternatives occurs up to here. 

5. After all Ideas have been presented^ a discussion of 
pros and cons of each alternative Is conducted. 

6. Group members then Independently rank order the 
alternatives from most acceptable to least acceptable. 

7. Those rankings are shored^ and the list of alternatives 
Is narrowed to the top few. 

8. Another discussion of pros and cons Is held^ and the 
process Is Iterated until an acceptable alternative Is 
Identified. 



I 

FerIc 



17 

36 



•ILLUSTRATION OF THE fiMfi LOGIC GATE 



A 



□ 



B 
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ILLUSTRATION OF THE flfi LOGIC GATE 



A 
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FAULT TREE ANALYSIS VALIDITY CHECK 



Is THIS AN INDICATOR Or INEFFECTIVENESS IN THE INSTITUTION? 
Is IT A PROBLEM THAT STANDS IN THE WAY OF SUCCESSFUL 
PERFORMANCE? 



Are all the major contributing factors listep below the 

TOP FAULT IN THE TREE? 



Do THE CONNECTING LOGIC GATES ACCURATELY CHARACTERIZE THE 
RELATIONSHIPS BETWEEN PRIMARY FAULTS AND THE TOP FAULT? 



COMPUTING A STRATEGIC PATH 



• 



1. Rate the imr tance or relative contribution of 
the fault to the occurrence or presence of the 
fault on the next higher level. 

2. Importance or contribution ratings must total 
1.0 for each level on each branch of the tree. 

3. Rate the frequency of occurrence^ or urgency^ 
of the bottom faults. 

1. These ratings need not total to l.o for each 
level of each branch of the fault tree. 

5. Use the formulas for each type of logic gate to 
determine weights for each primary fault. 

6. Draw the strategic path. 
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Illustration of Two Frequency Sec. , 



very rare very frequent 
j 1 

•01 1.0 

Points 




Low 



Medium 



High 



Frequency 
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Algebraic Formulas for Computing Strategic Path Values for Three Types of Logic Gates 



Formula 
Number 



Type of 
Gate 



Formula 



Exclusive OR 



SPW« « ^>»»(Fault,) ♦ PCFaultj) ♦ • . • P(Fault^) • ( importance weight 
of the more general fault) 



Inclusive OR 



IN) 
4:^ 



SPW « P(Faultj U Faultj U . . , Fauitj^) • (Importance weight of the 
more general fault) 

SPH (for a gate with 3 faults) = (P(Fault,) ♦ P(Fault2) + P(Fault3) - 
P(Fault, n Faultj) - P(Fault, n Faulty) - P(Fault2 0 Faulty) ♦ 
P(Fault| n Faulty n Faulty)} • (importance weight of the more general 
fault) where P(Fauit, n Fauitj n Fau!tj)«iP( Fault,) • ^(Faultj) • 
• P(Fault3) 



AND 



SPW » PtFault^ n Faulty fl . . . FauJtj^) • (importance weight of the more 
general fault) or 

0 

SPW « (PC^iultj) • PCFaultj) • . . . P(Fault|^)) • {Importance welijht 
of the more general fault) 



• SPW « Strategic Path Weight 

P ■ Probability of fault In non-bohavloral systems; weight calculates for the fault In behavioral systems. 



ERIC 
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THE PURPOSE OF THE STRATEGIC PATH 



A STRATEGIC PATH IDENTIk-MES PuACES TO START TO OVERCOME 
FAULTS AND TO IMPROVE ORGANIZATIONAL EFFECTIVENESS. 



A STRATEGIC PATH SHOWS THE TIGHT CONNECTIONS WITHIN THE 
ORGANIZATION WHERE THE MOST IMPROVEMENT IS LIKELY TO 
OCCUR. 



A STRATEGIC PATH SIMPLIFIES THE SEmRCH FOR WHAT TO CHANGE 
AND HOW TO IMPROVE THE SYSTEM. 
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- FOUR GENERAL STEPS IN CONDUCTING 
FAULT TREE ANALYSIS 

1. Identify a top fault. 

2. Identify primary (contributing) faults. 

3. Place the faults in tree form. 
Determine a strategic path. 
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ADVANTAGES AND DISADVANTAGES OF FAULT TREE ANALYSIS 



A. ADVANTAGES 

(1> Easier to Identify and agree on faults than strengths. 

(2) Faults match managerial concerns. 

(?) Broad participation Is required which builds commitment. 

('I) Understanding of the system is increased. 

(5) Description Is combined with prescription. 

(6) Potentialities ( could^s ) are able to be Identified. 

B. DISADVANTAGES 

(1) Not enough Information may be present ini;the system. 

(2) Biased results may occur because of scopegoatlng, etc. 

(3) A large amount of time Is required of c lot of people. 

(^1) There Is no guarantee that solving a problem on a lower 
level win lead to elimination of the top fault. 

(5) This focuses on weaknesses^ not strengths (e.g.> policy 
literature). 

(6) Some organizations function well because they are not 
understood. 
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-A SAMPLE OF QUESTIONS ASKED TO IDEKTIFY 
CRITERIA OF ORGANIZATIONAL EFFECTIVENESS 



1. What organizational characteristics do effective 
colleges and universities possess? 

2. What would need to change in this college or 
university to make It more effective? 

3. Think of an Institution of higher education that 
you Judge to be effective. What characteristics 
make It effective? 

^. Of the 130 or so characteristics of effective colleges 
and universities found In the literature, which ones 
are applicable to the effectiveness of this institution? 

5. Of the characteristics of effectiveness mentioned, which 
ones cannot be measured (because of unavailability of 
data, etc.)? 



THE RESULT: 



A listing of the characteristics that would be 
possessed by the most effective Institution of 
higher education. 
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ASSESSMENTS OF ORGANIZATIONAL EFFECTIVENESS IN 
INSTITUTIONS OF HIGHER EDUCATION 





Answers to 


■he seven ouiri*>]ines 


1. 


Constituency: 


Dominant coalition members 


2. 


Domain: 


Undergraduate 


3. 


Level of analysis: 


Organization 


^. 


Purpose: 


Identify major dimensions of 



effectiveness and Institutional 
profll<»s 

5. Time frame: Short-term ond static 

6. Type of data: Perceptions & factual 

7. Referent: Possession of traits^ and comparisons 

to other similar Institutions 
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NINE DIPENSIONS OF ORGANIZATIONAL EFFECTIVENESS 



1* Student Educational Satisfaction 



2. Student Academic Development 



3. Student Career Development 



4. Student Personal Development 



5. Faculty and Administrator Employment Satisfaction 



6. Professional Development and Quality of the Faculty 



7. Systems Openness and Community Interaction 



8. Ability to Acquire Resources 



9. Organizational Health 



I 
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SOME MAJOR FINLINGS RE6ARDIN6- 
- EFFECTIVENESS IN COLLEGES — 
AND UNIVERSITIES 



1. gQtterns of Orgonlzatlnnnl Effect Ivpnogg 

A. Certain kinds of Institutions hold distinctive profiles 
of organ Izotlonol effectiveness. 

B. Institutions that are declining score lower on effectiveness 
dimensions related to academic quality and to morale than 

do Institutions that are stable or growing. 

C. Institutional profiles of organizational effectiveness 
stay relatively constant over time. 

2. ASSflCLatlons between FffectlvenPR^ pnd othpr Organ! zntlnnnl 
Choracierlstlrs 

A. Institutions with a faculty union ore lower on the 
dimensions of organlzatlonol effectiveness than do 
Institutions without a faculty union. 

B. Certain indicators of Institutional financial health are 
strongly associated with organizational effectiveness scores. 

3. Predictors of Orgonlzotlo nol Effectiveness 

A. Characteristics of the external environment, administrative 
strategy, and resource availability ore Importont predictors 
of most dimensions of effectiveness, 

B. Adversarial relationships Inside and outside the Institution, 
OS well as adequate financial resources predict Improving 
organ Izatloncl effect Ivenes Dver time. 

C. Proactive (as opposed to reactive) strategies and a 
cosmopolitan (as opposed to local) emphases distinguished 
Institutions that Improved in effectiveness from those that 
declined. 



PROFILES OF EFFECTIVENESS FOR FOUR IHSTITITTIONAL CLUSTERS 
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- SOME MAJOR DISTINGUISHING CHARACTERISTICS AMONG INSTITUTIONS — 
-I- HOLDING DIFFERENT PROFILES OF ORGANIZATIOKAL EFFECTIVENESS 

I 

SOME DISTINGUISHING CHARACTERISTICS 

Affluent Institutions 
Academically oriented 
Liberal arts emphasis 

Affluent Institutions 
Professionally oriented 
EmphOi^is on faculty development 

Developing Institutions 
Professionally oriented 
Emphasis on fund raising 

Growing and developing Institutions 
Teaching oriented 
Emphasis on fund raising 

I 



I 
I 
I 




INSTITUTIONAL GROUP 

I 

|cholarly. High Morale Group 

I 

|cholarly^ Medium Morale Group 

I 

Internally Oriented Group 

I 

|edlocre Group 
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A CONPARISON OF EFFECTIVENESS DIFENSION MEAN SCORES FOR 
UNIONIZED INSTITUTIONS AND NON-UNIONIZED INSTITUTIONS 



S.O • 



v» 4.0 " 
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3.0 • 




UNIONIZED (N-18) 

— - NON-UNIONIZED (N=23) 
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UNIONIZED X 


4.21 


3.71 


4.47 


4,86 




.63 


.49 


.64 


.61 


NON-UNIONIZED T 


4.88 


4.36 


4.45 


5.17 


id 


.72 


.88 


.74 


.44 


F.RATIO 


1.30 


3.29 


?.57 


1.98 


SIGNIFICANCE 


n.t. 


.01 


n.t. 


n.s. 
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HYPOTHESIZED JEUTIONSHIPS BETWEEN FACULTY UNIONISM 
AND DIMENSIONS OF ORGANIZATIONAL EFFECTIVENESS 



Highly 
Eff«cMv« 



ABiLITY TO ACQUIRE RESOURCES 



Ineffective 




Not Newly Old 

Unionized Unionized Union 



Highly 
Effective 



MORALE DIMENSIONS 



Ineffective 




Not Newly Old 

Unionized Unionized Union 



Highly 
Effective 



ACADEMIC DIMENSIONS 



Ineffective 




Not Newly Old 

Unionized Unionised Union 
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FINANCIAL HEALTH INDICATORS 



1. Financial Independence - the proportion of revenue received from 

six different sources 

2. Financial FlexlolUty - the proportion of unrestricted revenues 

3. Financial Cushion - the amount of current revenues left unspent 

4. Revenue Drawing Power - the ability of the institution to attract 

revenues 

5. Endowment Yield - the amount of endowment Income relative to 

other similar schools 



AVERAGE CORRELATIONS OF FINANCIAL HEALTH INDICATORS WITH 
DIMENSIONS OF ORGANIZATIONAL EFFEaiVENESS 



Jii^BfiOSlm Averoqe Correlctlon 

Student Educational Satisfaction .zi88» 

Student Academic Development .802** 

Student Career Development -.561»» 

Student Personal Development ,396» 

Faculty ft Administrator Employment Satisfaction ,2^^ 

Professional Development ft Quality of the Faculty .806' 

System Openness ft Cotnnunity Interaction .055 

Ability to Acquire Resources .783** 

Organizational Health ,zi71» 

indlcQtor 

Financial I. dependence ,377» 

Financial Flexibility .5;3»» 

•Financial Cushion .532*» 

Revenue Drawing Power ,590** 

Endowment Yield ,5ii2** 
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• P<.01 
P<.001 
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MAJOR PREDICTORS OF ORGANIZATIONAL EFFECTIVENESS IN 

THREE MAIN DOMAINS 

0 

MORALE DOMAIN 

• Emphasis on academics and scholarship 

• Emphasis on student affairs 

• A perceived rich external environment 

• A perceived supportive external environment 

EXTERNAL ADAPTATION DOMAIN 

« Proactive strategies Implemented 

• Emphasis on public relations 

• Emphasis on public service 

• Emphasis on student affairs 

• Little financial Independence 

ACADEMIC DOMAIN 

• Selectivity In student admissions (high quality students) 

• Proactive strategies Implemented 

• Emphasis on academics and scholarship 

• A perceived rich external environment 
f High revenue drawing power 
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PREDICTIONS OF THE PERCENT CHANGE IN EFFECTIVENESS SCORES ON EACH DIMENSION 

19/0 TO 1980 



BETA CORR 
Change In St udent Educational Satisfaction 

Presence of a Union In 1980 -.4340 -.4340 .1883 

2* Change In S tudent Academic Develo pment 

Emphasis on Legal Matters .5459 5469 

Supportive Environment .3765 :521 .4400 

3' Change In S tudent Career Develo pment 

Emphasis on Fund Raising .3326 3826 

Complexity of the Envlromient -.4519 -.'3534 .3419 



Change In S tudent Parsonal Develo pment 

Emphasis on Finances -.4144 -.4144 



.1717 



Change In Faculty and Administ rator Emplovmi^nt Satisfaction 
Environmental Turbulence ".5971 -.5S7i .3555 

Change In Professional Devi>lop n,ent and Quality of the Faculty 
Environmental Turbulence -.6790 -.6790 .4611 

^* Change In System Openness and Conmunlty Interaction 

Proactive Strategies Implemented .4676 .4676 .2186 

8* Change In Ab ility to Acquire Resources 



Presence of • Union In 1980 -.4773 -.4773 

Expenditures Per FTE ..JiiJ 
Revenue Drawing Power .7367 -.0292 



.6229 



Change in O rganizational H^»lth 

Environmental Turbulence -.5091 -.5091 .2552 
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MAJOR PREDiaORS OF CHANGE IN ORGANIZATIONAL EFFECTIVENESS 

1976 - 1980 



PREDICTOR 



RELATIONSHIP 



Turbulent External Environment 
Presence of a Faculty Union 
Emphasis on Fund Raising ' 
Revenue Drawing Power 
Proactive Strategic Orientation 



NEGATTVE 
NEGATIVE 
POSITIVE 
POSITIVE 
POSITIVE 
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EFFECnVENEsf fKJ? ^"^^ ^^Cimii, REMAINED STABLE. OR IMPROVED IN ORGANIZATIONAL 



Elgenvilue CanonlcAl Hilks' chi d.f. Significance 

Correlation Lambda Square 



15.3088 .9689 .0265 70.771 24 



.0000 



Variables 



Major Doctoral Classification 

Gener:.'i Baccalaureate Classification 

Preserice of a Union in 1980 

Expenditures Per PTE Student 

Percent In-state Undergraduate Students 

Change in Enrollment From 1976 to 1980 

Turbulent environment 

Supportive Environment 

Top Managers Emphasize Internal Affairs 

Top Managers Emphasize Fund Raising 

Top Managers Emphasize Legal Matters 

♦ p .05 
** p .01 
**♦ p .001 



Discriminant 


Correlation with 


Coefficient 


Discriminant Score 


- .2185 


.4405** 


1.6837 


-.1344 


3.3011 


-.57/6*** 


2.2036 


.5597*** 


-2.0901 


-.9977*** 


1.7905 


.2675 


- .5046 


-.0597 


-2.5093 


.6119*** 


-2.8277 


-.4972^ 


-2.8875 


.4472** 


.5453 


-.3754* 



Croup 

Declined in Effectiveness From 1976 to 1980 

Remained Stable in Effectiveness 

Improved in Effectiveness From 1976 to 1980 



ERIC 



65 



Centroid 

4.4065 
3.2160 
-3.4222 



Percent of Institutions 
Classified Correctly 

lOOX 
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MAJOR DISCRIMINATORS AMONG 

- DECLINING. STABLE. AND IMPROVIf^G INSTITUTIONS . 

IN OVERALL ORGANIZATIONAL EFFECTIVENESS. 1976 - 1980 



Institutions Thot Improved 

• Slack resources available 

• Oriented strategically toward the external environment 
and the acquisition of resources 

• Cosmopolitan In studentbody 

Institutions T hat Declined 

• Little slack r«;sources 

• Focused on i:iternal Institutional affairs 

• Adversarial environment, both Inside and outside the 
Institution 

• Studentbody mostly In-state students 
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IMPLICATIONS FOR ADMINISTRATIVE BEHAVIOR 



1. No Institution scores high on all dlnr-enslons of 
organizational effectiveness. Tradeoffs must be 
made by administrators regarding what kinds of 
effectiveness will be nraximized^ and what kinds 
will be ignored. 

2. Because different constituencies have different 
preferences -^garding organizational performance^ 
odminlstrctors must consciously select those groups 
whose preferences will be satisfied. 

3. Conservative^ reactive^ and internally oriented 
strategies on the part of top administrators are 
associate?^ with declining effectiveness over time. 
Proactive^ externally oriented strategies are 
associated with improving effectiveness over time. 

1. Acquiring financial slack in an institution^ even 
in times of retrenchments is an important strategy 
for maintaining and improving organizational effectiveness. 

St Managing the external environments so as to produce 
political slack and institutional legitimacy^ is more 
Important In Improving effectiveness than is managing 
Internal affairs. 



strategic Responses to Threats of Decline 



Domain Defense 

Tlie Goal Is to Preserve tiie Legitimacy 
of the Domain 

Domain Offense 

The Goal is to Expand the Domain 

Domain Creation 

The Goal is to Add Related Domains 
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EXAMPLES OF DOMAIN STRATEGIES 



DOMAIN DEFENSE 

• Activate support from alumni and trustees 

• Form lobtylng groups 

• Organize consortia and share services 

• Acquire Increased autonomy from centralized control 

• Prioritize consolidation efforts (eliminate black holes) 



DOMAIN OFFENSE 

• Expand current markets or student groups 

f Use current resources to engage In other^ non- 
tradltlonal activities that bring resources 

• Do aggressive marketing and recruiting 

• Cultivate non-earned revenue sources 

• Reaffirm and expand Institutional expertise 



DOMAIN CREATION 

• Add new programs In high demand areas 

• Acquire revenue generating subsidiaries 

• Engage in capital investment 

• Implement public service ventures In neglected areas 

• Expand offerings to new geographical areas 
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